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Abstract 
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1 Introduction 



We consider the process {yt)t>o governed by the stochastic differential equation 

dy, = S{y,)dt + a{yMWt, 0<t<T, (1.1) 

where (W^,J-'^)^^q is a standard Wiener process, y^ is a initial condition and 
= {S, a) are unknown functions. For this model we consider the pointwise 
estimation problem for the function S* at a fixed point Xq G M (i.e. S'(xq)), on 
the basis of the discrete time observations of the process fll.lj) . i.e. 

iytJi<j<N, (1-2) 

where tj = jS, N = [T/S] and 6 is some positive fixed observation frequency 
which will be specified later. Usually, for this problem one uses kernel estima- 
tors Sj^{xq) defined as 

where ^{y) is a kernel function which equals to zero for \y\ > 2 and will be 
specified later, < /i < 1 is a bandwidth, Ay^ = — y^ and Atj^ = 6. 

Main difficulty in this estimator is that the denominator is random. There- 
fore, to obtain the convergence rate for this estimator we have to study the 
behavior of the denominator, more precisely, one needs to show that 

N 



k=l 



where 



^A'^h,xJ= / '^h,xM(i^iy)dy (1.4) 



and is the ergodic density defined in f l2.2p . 

Unfortunately, the ergodic theorem does not permit to obtain this kind of 
result because the times and the bandwidth h depend on T. Usually one 
obtains such properties through concentration inequalities for the deviation in 
the ergodic theorem, i.e. one needs to study the limit behavior of the deviation 

N 
k=l 

for some functions (p which can be dependent on T, for example, </>(■) = ipf^ x^^i')- 
More precisely, we need to show, that for any e > and for any m > 0, 
uniformly over ^9, 

hm T™P^(|D^(^, )|>£t)=0, (1.6) 
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where is the law of the process {yt)t>o under the coefficients ^ = {S,a). 
Usually, to get properties of type fll.6p one needs to establish an exponential 
inequality for the deviations (11. 5p . 

There are a number of papers devoted to concentration inequalities for 
functions of independent random variables (we refer the reader to [2] and ref- 
erences therein), for functions of dependent random variables (see [1], [S]) IS])- 
For Markov chains such inequalities were obtained in [T] . For continuous time 
Markov processes an exponential concentration inequality was obtained in [3] 
(see also references therein). Some applications of concentration inequalities 
to statistics are presented in [13]. Concentration inequalities for diffusion pro- 
cesses are given in [8], [16], [18] . 

For statistical applications, we need uniform upper bounds for the tail 
distribution over functions like to the exponential bounds in [8j . We can not 
apply directly the method from [8], since there it is based on the continuous 
times version of the Ito formula. In this paper we apply this approach through 
uniform (over the functions 5") geometric ergodicity. We recall (see [I5]), that 
the geometric ergodicity yields a geometric rate in the convergence 



for any integrable functions g and any initial value x G M. Here denotes the 
expectation with respect to the distribution P^. In [lOj through the Lyapunov 
functions method it is shown that the process (11. II) is geometrically ergodic 
uniformly over functions "i? = (5*, a) from the functional class G defined in 



The paper is organized as follows. In the next section we formulate the main 
results. In Section [3] we introduce all the necessary parameters. In Section S] 
we show a concentration inequality in ergodic theorem for the continuous ob- 
servations of the process (11.11) . In Section[5]we announce the uniform geometric 
ergodic property for the process (11.11) . In Section [6] we give the Burkholder 
inequality for dependent random variables. In Section [7] we prove all main 
results. The Appendix contains the proofs of some auxiliary results. 

2 Main results 

First we describe the functional class G for functions i) = {S, a) defined in 
[lUj . We start with some real numbers > 1, M > and L > 1 for which we 
denote by j^^^ the class of functions S from C^(]R) such that 



lim E^{g{y^)\yQ = x) = 7i^{g) 
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and 

-L < inf S{x) < sup S{x) < -L-^ . 

Furthermore, for some fixed numbers < 0"^^;^ < a^.^^ < oo, we denote by V 
the class of the functions a from C^(]R) such that 

(Train < i^f min(|a(x)| , |cr(x)| , [&{x)\) 

< supmax(|(T(x)| , |cr(a;)| , [&{x)\) < a^^^. 

Finally, we set 

= S^,AfXV. (2.1) 

It should be noted (see, for example, [H]), that for any -d = {S,a) G O, the 
equation (11.11) has a unique strong solution which is a ergodic process with the 
invariant density g,^ defined as 

q^{x)= (^j a-\z)e^^'^d^ ^-^(a;) e^(") , (2.2) 

where S{x) = 2 S^{v)dv and S-j^{x) = S (x) / cr"^ (x) . 

Now we describe the functional classes for the functions 0. First, for any 
parameters i^q > and > we set 

V,^,,^ = {0 G C(M) : |0k < z/o , I0L < ^i} , (2.3) 

where \(f)\^ = \^{y)\ dy and |0|, = sup^^^ \^{y)\. 

For any function from C^(]R) we denote by C^{(f)) the generator operator 
for the process (II. ip . i.e. 

CMiy) = s{ymy) + ^4>{y)- 

Using this notation, we set 

/x(0) = sup ||£^(0)L and Jl{(j)) = sup |7r^(0)| , (2.4) 

where 7f^(0) = 7r^(£^(0)). Now for any vector u = (z/q, u-^, 1^2, 1^3, z/4) from 
we set 



/C, = ^ G V,^,,^ : II0L < ^2 , K<l>) < ^3 > < ^4 r (2.5) 
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Theorem 2.1. For any vector v = (z/g, u-^^, 1/2, z/3, u^) from and any 

< 6 < 1 there exist positive parameters Zq = Zq(5, z/), 7 = 7(5, z/) and 

K = x{6, v) such that 

sup sup sup sup e""^^'^^"^'^) (|^t(</')I > ^v^) < 4, (2.6) 

r>i 2>2(, 0e/c^ i?ee ^ ^ 

where the parameters Zq, 7 and x are defined in fl3.5p -( 1XB]) . 

Now we apply this theorem to the pointwise estimation problem, i.e. for the 
functions ^^^3;^ defined in (11. 3p . To this end we assume that the frequency 5 
in the observations ( II. 2p is of the following form 

5 = ^T = ^, (2.7) 

where the function Irp is such that for any m > 

lim 7^ = and lim = +00 . (2.8) 

T^oo T"^ T-s>oo m T 

Further, let e = be a positive function satisfying the following properties 

/ J 
lim erp = 0, lim = and lim — ^ — = +00 . (2-9) 

r-i>oo T-5>oo Terp T^oo In T 

We can take, for example, for some l > 

/^ = ln^+6'(T+l) and ^ 



in'(r + 1) ■ 



Theorem 2.2. Assume that the kernel function \E' in (11. 3p is two continu- 
ously differentiahle. Moreover, assume that the functions 6rp and Ij. satisfy the 
properties (12. 7p and (12. 9p . Then there exist coefficients z* = z*{'$) > and 
Y = 7*(^') > such that 

lim sup e"^*'^ sup sup sup (|^t(^m )I > < 4, (2.10) 

where = z*/lj^, the parameters z* and 7* are given in Section\^ 
This theorem implies immediately the following 

Corollary 2.1. Assume, that all conditions of Theorem {KM hold. Then, for 
any m > 0, 

lim sup sup sup sup P^ ( 1-0^(^/1 ^ )| > o^T) =0. 



5 



Now we study the deviation (11.51) for the function 

(2.11) 

where xiv) = '^{\y\<i}- 

Theorem 2.3. Assume that the parameter 6 has the form fl2.7p . Then, for 
any m > 0, and for any function e^, satisfying the condtions fl2.8p and fl2.9l) 




(2.12) 



Remark 2.1. It is well known that to obtain the optimal rate in the estimation 
problem for a differentiable function S in the process (11.11) one needs to choose 
the bandwidth h as 

with the regularity parameter a > 1. This means that, really for the pointwise 
estimation problem, h > T~^/^ . But in the quadratic risk one needs to choose 
the parameter h as h = T'^^"^ (see JBi-l^,J3i)- 



3 Parameters 

In this section we introduce all necessary constants and parameters. First, we 
set 

y^=e^fmM and v^ = ,/^^e^"/^'"'^\ (3.1) 

where = 2M/(T^.^ and = l/La^^^. Moreover, as we will see in Appendix, 
the ergodic density f l2.2p is uniformly bounded by q*, where 

2 

mm 



Now we set 



r = r{iy,) = ^(l + v, + q* (x, + v^)) e^^^^ , (3.3) 



(t2. 

mm 



where the parameter is defined in (12.30 . Now using this function we set 

= = 108r2(3p2 + .2 + 2a2 ) ^^'^^ 

^ ' '^O max' 

where p = max (^lyj , o^^^^^L, 2(x, + ML) 



Now for any 6 > and any parameter vector u = (i^q, z/j^, z/2, z/3, i/^) from 
i^, we set 



— z, 



u) = 5^/2 max (2c;z/3 , 2c;z/2 , z/^T^/^ ^ ^^^y-^/^) , 

max (c*z/3 , C2Z/2) , (3.5) 



where 



The parameters R and /t are defined in Theorem 15.11 Finally we set 

1 , /c- ^ 9Kn(l-(5) , , 

7 = - and X = x(5, z.) = ^^i^ . (3.6) 

Now we set 

Ml = M + L(x, + |xo| + 2) . (3.7) 

Now for any inegrated two times continuously differentiable M — )■ M function 
we define 

k,(^) = max (l^li , l^li , , II^IL , II^IL) • (3.8) 
Using this operator we define the parameters 

z; = \,K{^il) and r* = A2k,(vi/), (3.9) 

where 

Ai = max (2c*Mi , 20* , M^q* , l) and A2 = max (c*Mi , c*) . 
Finally, we set 

7* = ^. (3.10) 

4 Continuous observations 

In this section we study the deviation in the ergodic theorem for the continuous 
observation case, which in this case is defined as 

A^(0) = ^ £ - ^M) , (4.1) 
where is any integrated function, i.e. < 00. 
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Proposition 4.1. For any i'q> Q and z/j^ > 



,2 



sup e^o^ sup sup sup P^(|Ar(0)| > ^) < 2, (4.2) 

2>o T>i 06V,^,,^ i9ee 

where the parameter Kq is given in (13 ■4p . 

Proof. Similarly to [8j firstly we show that the deviation (14. ip has an expo- 
nential moment, i.e. we show that for the parameter 

sup sup E^e^o^T^ < 2 . (4.3) 
T>i -ffee 

Indeed, to show this inequality we need to estimate the expectation of any 
even power for the deviation Arp{(f)). To this end we have to represent this 
deviation as the sum of a continuous martingale and a negligible term. For 
this one needs to find a bounded solution for the following differential equation 

vM + ^^fM = 0(«) = 0(n) - irM . (4.4) 

One can check directly that the function 

v,{u) = -2 r exp{2 r S,iz)dz}dy (4.5) 



yields such a solution. We recall that the function is defined in (12. 2p . 
Moreover, due to Lemma IA.2I from Appendix implies this function is uniform 
bounded. By applying the Ito formula to the function V{y) = v^{u)du we 
following representation 

^^iyJds = V{yT)-Viy,)~CT, (4-6) 



where = '^^{ys)'^iys)^'^s- Therefore, for any T > 1 through Lemma lA. 21 
we can estimate Aj,(^) from above as 

|A^(0)| < r\y^\ + r\y,\ + K^l • 



Moreover, taking into account (see [12], Lemma 4.11), that for any m > 1, 

E, (CT)'"<(2m-l)!!r2™a^™ 
we obtain by Proposition lA.ll , that for any m > 1 

E,|A^(0)P™ < 3^"-^ (^r'^iEM'"^ + \y,\'n + 

< (3r)2" (4(m + l)(2m-l)!!p2" + y2'"+(2m-l)!!(T^'^J . 
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Therefore, taking into account the definition of Kq^ we obtain 
E^g«oA?.W = 1 + ^ ^(3r)2'^ (4(2m + 1)!!^^"^ + y^"^ + (2m - l)!!cr^';^J 



ml 

m=l 



< 



1 + ^ ^^(3 rf^ (4(3/)™ + yl"^ + ) 



m=l 



< 1 + ^(1/2)"^ = 2. 



m=l 



From here we obtain the inequahty f l4.3p and by the Chebychev inequahty we 
come to the upper bound (14.21) . Hence Proposition 14. 1[ □ 

Remark 4.1. It should be noted that the inequality (14.21) is shown in JS] for 
the process (II. ip with a = 1. Thus Proposition 4-1 extends teh result from /<§/ 
for any diffusion function a. 



5 Uniform geometric ergodicity 

Here we announce a result on geometric ergodicity obtained in [10]. 
Theorem 5.1. There exist some constants R> 1 and k, > such that 

sup e- sup sup sup iaiv^U = ^) - -^9)1 < ^ 
*>o \\g\\,<i xms&e 1 + \x\ 

where the parameters R and k, are given in [JJ}^. 



6 Burkholder's inequality 

In this section we give the following inequality from P].|17]. 

Proposition 6.1. Let (f2, J-", (J-'j)-^<^<^, P) be a filtered probability space and 
{Xj, J^j)^^j^^ be sequence of random variables such that for some p>2 

max E |X.|P < oo . 

l<j<n ■' 

Define 

. 2/p 

hn^p)= (E(|x^.|5^|E(x,|j;.)ir/' 

k=j 
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Then 

p/2 



E I ^ X^. r < (2pr/M 5^ I . (6.1) 

j=i \j=i 



Proof of this Proposition is given in Appendix. 



7 Proofs 



7.1 Proof of Theorem [2TT 



First note, that by Proposition lA.ll and the Holder inequahty we obtain for 
any a > 1 

supsupE^(|?/,nyo = x) < 4(« + l)°/V". (7.1) 

t>o i?Ge 

Now we represent the deviation -0^(0) as 

Dt{<P) = [ (0(%) - 7r^(0))dt + A^ j, - T 

= A^(0) + A^ T - A^ T , (7-2) 

where 

To estimate the term A^^ ^ we represent through the Ito formula the difference 

^iVt^) - 4>{yt) as 

0(y,p-0(yj= r £^(0)(yjd.+ p^{yMys)dw, 

= nMih + *,(t) + / ' 0(yja(yjdiy, , 
where ^ ^ 

and '?/'(y) = ~ ^^(0)- Now setting 

X- = ^j{t)dt and r/^. = UJj{t)dt , 
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we obtain 

i=i i=i 

To estimate the second term in the right-hand part of (17.31) . we make 
use of the Proposition l6.1[ We start with verifying its conditions. Putting 
•^s — '^{Vu , < M < s}, we obtain by Theorem 15.11 that for any t > s and for 
any from the functional class fl2.5p 

|E^ I < i? (1 + bJ) e-''(*-) <u,Ril + \y,\) e''^^'-^^ . 

Therefore, for any k > j, 

\E,{X,\T,^)\<Re-{l + \y,J)u,6'e-^'('^-^K (7.4) 

It should be noted also, that the random variables Xj are bounded, i.e. 

\X^\<iy,6\ 

To estimatie the probability tail for the sum Yl^-^ -^j ^^^^ inequality 
(16.11) . For this we need to estmate the coefficients bjj^{p) for any p > 1. From 
here, taking into account that 1 — e''^^ > ti5e~'^ and that for p > 2 




we can estimate the coefficient h- j^{p) as 

< ^^e^^^' (l + (E|y,J^/2)2/^) , 
where = i^g^^. Now the inequality (17. ip yields 

where 

R^ = -Re^^{l + p). 
Using this in (16. ip we obtain, that for any p > 2, 

N 
k=l 
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Therefore, by Chebyshev's inequality 



N 



i9 



k=l 



with a = 2^fR[c,l z. Minimizing now the right-hand part over p > 2, we obtain 
for z > Ae^/R^ly^5^/^ 



P.I lE^;^l>^v^l < (7-5) 

where q = 2e^yR^q. 

Moreover, note that by the Burkholder-Davis-Gundy inequahty, for any 
a > 1, 

Ejc.^-(t)r< («r/^ jt^. - tf/^ 

Using this and the the Holder inequality, we get 

Note, that in this case in the right hand of the inequality (16. ip 
Therefore, similarly to the inequality f l4.5p we find, that for all z > 2<^2, 



P. (^lE^.I>^v^j < e-^/^S (7.6) 



where = ^2 65^/^2 a^^^. Now from (O]), dMD-dMD it follows that for 



Z>Zo 



P, (l A^^^l > zv^) < P,, ( I f2 X,\ > zv^/4^ 



k=l 

N 



+ ^'^l ^ < 2 e-'/'^ , (7.7) 



k=l 



when the parameters Zq and r are given in (13.51) . Moreover, note that due to 
(12.51) the last term in (17. 2p is bounded, i.e. 



|A2,r|<25||0L<25z/2<ZoViV/4. 
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Finally, from (17. 2p for z > Zq one has 

< (yr|A^(0)| > szTiv/s) 

+ P^ (lAi^rl > 3zy/N/8^ . 

Taking into account here, that N/T > {1 — 6)/6 for any < 6 < 1 and T > 1, 
we obtain, that 

PA\DA4>)\ > z^) < p. [\^Tm > 

+ P^ f |A, ^1 > IzVn) . 



Therefore, applying here the inequalities f l4.2p and (17. 7p we come to the upper 
bound (I2.6p with the parameter x given in (13.61) . Hence Theorem 12. 1[ □ 



7.2 Proof of Theorem [272 

Firstly, note that in this case 

Moreover, taking into account that |5'(y)| < M + Lx^ + L\y\, we find that 

sup \S{y)\<M,, (7.8) 

l?/l<kol+2 

where is given in (13. 7p . 

Therefore, in view of the fact that < /i < 1, we can estimate from above the 
parametrs (12. 4p as 

l^iA,.,) < f^*h-^ and Jl{A,.J<Ji*h-\ (7.9) 

where 

/i, = max (ll^ll, , ll^ll,) Ml and Jl, = max (\^\^ , M^g* . 

Therefore, the function ipi^ belongs to the class (12. 5p with the following pa- 
rameters 



hTrl 11^ * * f^* A''* 
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Therefore, in this case the coefficient (13 ■4p equals to /tgd^li) the param- 
eters fl3.5p can be represented as 



_ 6^ 

^3/2 



max (2c;/i, , 2c*||^||> , /I^T^/^ ^ ||vi;||^/,22^-i/2 



max 



^3 ---^-^^c>,,c;i|v]>||>j . (7.10) 
Therefore, thanks to the condition (12.81) for any T'^^^ <h<l 

Zq < It^^^ z* and r < r* , (7.11) 

where the parameters z* and r* are given in (13.91) . Note now that, by the 
condition (12.71) 

{\DAA,J\ > «t) < p, [\DAA,J\ > ^1 Viv) 



where = aj ^Ij.. The ffist inequahty in (17. lip imphes that > Zq for all 
a > = z*/lj'. Moreover, from the last inequality in (17.111) it follows, that 
for a> 



min (x2^ , 7) = min ( xz-^ , — ) > min [ x- ° t\I t 



4r/ ~ \ /tV^ 4r* 



Taking into account here the definition of k in (13. 6p and the form for b given 
by (12. 7p we obtain that for sufficiently large T 



'^fi /'j^ \/ ^ TP I ^/ 

mm I X ^^-= , — - — = — - — 

l^JT^ At* / At* 



Thus, through Theorem 12.11 we come to the inequality (12.101) . Hence Theo- 
rem [22] □ 

7.3 Proof of Theorem Q 

First we represent the tail probability as 

p.(|^t(x.,JI > 6^t) =Ii + I 
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where 

N 
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and 

Let us define now the following smoothing indicator functions 

1 /■+°° fz-u\ 

and 

1 /■+°° . fz-u 



where r/ is a smoothing positive parameter which will be specified later, is a 
two times continuously different iable even M — )■ R function such that V{z) = 
for \z\ > 1 and 

V{z)dz = 1 . 

-1 

It is easy to see that, for any ?/ G M and < r] < 1/2, 
and '^2,riiy) = for \y\ > 2. Moreover, for the functions 



using the inequality flA.4p . we can estimate the difference between the coore- 



sponding ergodic intergals fll.4p as 

Mxh,xJ -^Ai'i,h)\ < ^m* ■ 

Therefore, choosing here r/ = we obtain, for sufficiently large T, 

I,<P,(|D^(0,,)|> e^T/2) . 

One can check directly that in this case the operator (13. 8p has the following 
asymptotic (T — )■ oo) form 

k.(^,,) = o {r') ■ 

Therefore, from f l3.9p and (17. lip it follows that for T oo and h > T^^/^ 



^o(M = O (r/^ V^') and r(0,J = O (r^- 
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I.e. 

^0(^ = 0(77371) and r(0,^J = Ol^^ 
Now we have 



where z^ = ej-j a/^- The last equahty in (12. 9p imphes > for sufficiently 
large T. Moreover, taking into account, that there exists a constant > 
such that for sufficiently large T 



>^^\ > c^Ty'lj.erp and 7 > cjj.y'lj.ej, , 
i.e. for sufficiently large T 

min {xz-^^ , 7) > cJrp^JT^e^ . 
Therefore, by Theorem 12.11 for sufficiently large T 

Now the last condition in (12. 9p yields the equality (12. 12^ . Hence Theorem 12.31 
□ 

A Appendix 



A.l Proof of Proposition 16.1 

We set 

n 

K{t) = nS^_, + tXS with 5„ = ^X^.. 

By the induction method we assume that for any 1 < /c < n — 1 and < t < 1 

K{t)<{2pr/'Bf{t), (A.l) 

where 

fc-i 
i=i 

Note now that as is shown in [T7| (Theorem 2.3) 

n „i 

E|5„r = p(p-1)5^ / nS,-r + vX^r\-vX2^ + T{j,n))dv . (A.2) 
i=i 
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with 

n 

T(j,n)=X^.^E(X,|J-.)- 

k=i 

Therefore, 

Kit) = p(p - 1) /' E|5^._i + vX^r\-vX2^ + n, t))dv 
Jo 

where 

GO", n, t) = T(j, n - 1) + tX- E(XJ J".) . 
Moreover, we can estimate as 

M^) <g f\\S._, + vX,r'\G{i,n,t)\dz 

.7 = 1 



ft 



p2 

+ r E\S^.^ + sXJ^-'Xlds 
Jo 

Now taking into account that for < i < 1 

{E\G{j,n,t)\^/'f' < 6^.„(p), 
we obtain by the Holder inequahty 

E\S^_, + vX/-'\G{^,n,t)\dv < f h'^iv) b^^„{p)dv , 
Jo Jo 

where a = 1 — 2/p. Therefore, 

Kit) 



p2 

J 



^J2hnip) h';{v)dv + b,^M Ki')ds 

i=l -^0 -'O 



Now by the induction assumption for any 1 < j < n — 1 

•1 pi 
i'^{v)dv < (2p)(^'-2)/2 / _^ 



KniP) Kiv)dv < {2p)^-'y' Bf~'y\v)dvb^(p). 



Moreover, taking into account that 



B,iv)<Y.Kn + ^hniP)^ 
i=l 
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we obtain that 

■^0 ^ V i=l i=l 

This imphes for any < t < 1 

Kit)<K f K{v)dv + f,, (A.3) 

with 

K = P\,nip) and /„ = 2p^bj^^{p) 
Now by setting 

zit)= f h:is)ds+^, 

Jo '^n 

we obtain from (lA.Sp that 

Zit) < k^Z^it) . 

Now introducing 

g{t) = Z{t)-k'^^Z'^{t), 
we obtain the differential equation 

Z{t) = klZ%t)+g{t) 

with g{t) < 0. From here we obtain 

i.e. 

Zit) < \ Z^/P{0) + -kit 
Substituting this bound in flA.Sp we obtain 



K{t) < k^z{t) < k„ i^z'/^io) + -kit 



Hence Proposition 16.11 □ 
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A. 2 Uniform bound for the invariant density 
Lemma A.l. The invariant density (12. 2p is uniformly bounded: 

sup sup q^{x) < q* < oo , (A. 4) 



where the upper bound q* is given in (13. 2 p . 

Proof. First, note that through the definition of G we can check directly that 
for any |a;| > 

2 r S,{v)dv < f3,\x\ - f3,{\x\ - xj2 , (A.5) 
Jo 

where the coefficients and P2 given in (13. ip . Therefore, taking into 
account, that for |x| > 

2/ S,{v)dv<P,x,, 

we obtain that 







2 sup / S^{v)dv < I3^x^ + . 
Estimating now the denominator in (12.21) from below as 

1 



\z)e^^'Mz > / a-\z)dz > 



a'' 

max 



and taking into account the definition of q* we come to the upper uniform 
bound (lA.4p . Hence Proposition lA.ll □ 

A. 3 Moment bound for the process y^. 
Proposition A.l. For any m > 1 

sup sup E^lyJ^™ < 4(m + l)(2m- l)!!p2™ < 4(2m)"p2-^ 

where p is given in (13. 4p . 

Proof. First note, that through the Ito formula we can write for the function 
z^{m) = E^y"^^ the following intergal equality 

z,{m) = z,{m) + 2m f ^..yf^'' S{y,)ds 
•Jo 

+ m(2m-l) ! E^y2m-2^2(^j^^^ 
J n 
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which can be rewritten as the differential equahty 

i,(m) - 2mE^y2m-i ^^^^ ^ ^(2m - l)E^|/f . 

Taking into account here that sup^^^a^{x) < cr^^^ we obtain, that for any 
m > 1 and t >0 

i,(m) < 2mE^|/f-i5(|/,) + m(2m - l)a^,,;a;,(m - 1) . 

Now we need to estimate from above the function x'^"^~^S{x). Obviously, that 
for any K > :x.^ 



Ml 



x'^-'S{x) < K'--^ sup |5(a;)|l{|,|<^} + x'^^^^^^^y 

\x\<K ^ 

Taking into account that sup|^|^^ < L, we obtain, for any x e [x^, K], 

\Six)\ < |>5(xJ| +L|a;-xJ <M + L(ir-xJ. 
Similarly, we obtain the same upper bound for x e [—K, — x^]. Therefore, 

sup \S(x)\ <M + L(X-xJ. 

\x\<K 



Consider now the case \x\ > K. We recall, that sup|^|^^ S{x) < —L 
Therefore, 



-1 



x - K LK 
Choosing K = 2{y.^ + ML) yields 

S{x) ^ 1 

X - 2L' 

Therefore, 

„2rra— 1 Q( ^\ ^ 7>'2m— 1 ( '\/r \ T { ^^ ^2mi 



x'-^-'S{x) < K'"^-' (M + L{K - xj) - — x^'-l^i.i^^} 
= (M + L(i^ - xJ) + f x2'"l{|.|<^} - 



m 2 

where 



= (2(x, + ML))^"^-^ (2M + X, (L + L-^) + 2L2m) 
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From here it follows, that 

z^^m) < 2m — m z^i^m) + m{2m — l)cr^3^j^ ~ 1) • 
We can rewrite this inequality as follows 

z^{m) = —L^^mz^im) + m(2m — l)a'lz^{m — 1) + ^/'j , 
where sup^^^ ipt < 2m A^. This equality provides 

z^{m) = 2o(m)e-"^^"'* + m{2m - l)a^ [ e-"^^''^'-'^ z,{m - l)ds 



< m(2m - 1)0-^^^ f e-™^-^(*-)z,(m - l)ds + , 

where = y"^ + 2A^L. Setting Bq = 1 and resolving this inequality by 
recurrence yields 

m 

z,{m)<A{2m-mY,{al^L)-^B^. 

j=0 

It is easy to see, that 

B„<4(max(||/or,4(x, + ML)2))™. 

Therefore 

sup z^{m) < 4(m + l)(2m- l)!!p^"^ <4(2m)"p' 



2m ^ A('^^\Ta „2m 

1 

t>0 



where p is defined in (13 ■4p . Hence Proposition lA.ll □ 



A. 4 Properties of the function ( 14.51 ) 



Lemma A. 2. For any integrated function (p the solution (14.51) is uniform 
bounded, i.e. 

sup sup \v^iy)\ < r , 
where the upper bound r is introduced in (13.31) . 
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Proof. Firstly we note, that for any from G and any intergated M — )■ 
function 

k^(0)l<?*l0li- 

Moreover, by the definition of the parameter we get 

2 sup < (3^. 

u|<x. 

Therefore, for < m < we can estimate the function as 
I^.HI<^((l + ?X)l</'li + !(</>)), 



mm 



where fi^ is given in (13. ip and 



1(0) = / (|0(2/)| + g*|0k)e'^^'.''^^^^'^dy. 



To estimate this term note that similarly to ( 1A.5|) we can obtain that for any 
y > a > 

2 r S^{z)^z < f3,{y - a) - /^^(y - af . (A.6) 



Using this inequlity for a = x^, we get 

1(0) < / |0(y)|e''i(J^-"*)-^2fe-xJ^di/ + g*|0|i / e'^i^-'^^-' d^ 







POO 

< sup e^i"~^2"' + g* / e^i"-^2-' d^ 

2>0 in 



< I0li (^1 + 9*^2) ' 

where the parameters v-^ and are introduced in fl3.1l) . Therefore, taking into 
account the definition fl3.3l) . the last inequality implies 

sup sup \v^{u)\ < r . (A. 7) 

See o<?i<x. 

If M > x^, then through the inequality (1A.6P we estimate the function v^{u) 
from above as 

sup sup \v^{u)\ < + q*V2) < r . 



Let now u <0. Taking into account that 

0(y) 



'^^^^ exp{2 r 5i(;2)d4dy = 
•^0 
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we can represent the function as 



Similarly to (lA.Gp . one can check directly, that for any y > a > 



Therefore, by the same way as in the proof of (]A.7p we can estimate the 
function v^{u) as 



sup sup |f^(M)| < r . 
i9ee u<o 



Hence Lemma [A.2[ □ 
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